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ABSTRACT 

The jackknife is a general inferential technique 
intended to ameliorate the problems associated with inadequate 
sampling theory. The research reported herein is directed at 
investigating the utility of the jackknife for establishing 
confidence intervals on and testing hypotheses about the 
disattenuated correlation coefficient for small samples. A review of 
the literature is made. Several computer simulations were performed 
to investigate the utility of the jackknife. The theory of the 
jackknife implies that the jackknife statistic is approximately 
distributed as a Student - t variate with the appropriate degrees of 
freedom. Results include: (1) The direction of the difference between 

the theoretical and actual cumulative proportions of jackknife 
statistics which were at or below the 10 percentile points of 
comparison varied across the different values of p(TX, TY) ; (2) The 

jackknife was sensitive to changes in the values of the reliabilities 
for each combination of p(TX, TY) and N; . Conclusions include: (1) It 

is urlikely that a mathematical model can be formulated to describe 
the sampling distribution; (2) The performance of the jackknife was 
sensitive to changes in the values of the input a parameters; and (3) 
The jackknife can be used to set approximate confidence intervals. 
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Jackknifing Diaattenuated Correlations* 

W. Todd Rogers 

National Assessment of Educational Progress 

Despite authoritative support for the use of disattenuated 
correlations in certain experimental situations* their actual 
use in these situations has been limited. This may partially 
be explained by the restricted availability of inferential 
procedures due to the lack of adequate distribution theory for 
the disattenuated correlation coefficient. The jackknife (Tukey, 
1958) is a general inferential technique intended to ameliorate 
the problems associated with inadequate sampling theory. The 
research reported herein is directed at investigating the utility 
of the jackknife for establishing confidence intervals on and 
testing hypotheses about the disattenuated correlation coefficient 
for small samples. 

Disattenuated Correlation Coefficients 
Classical test theory (Gulliksen, 1950; Lord and Novick, 

1968) is based upon the assumption that an observed score for an 
examinee can be regarded as the sum of two unobservable components: 
a true T and an error of measurement E. It is assumed that the 
error score for one measurement is independent of that for another. 



* This paper is based upon part of the author's doctoral disser- 
tation (Rogers, 1971) completed at the University of Colorado. 
The author is greatly indebted to Dr. Gene V Glass, who, as 
thesis advisor, generously contributed his time, guidance and 
encouragement . 
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Consequently, if it can be assumed that the relationship between 
two sets of measurements is linear , the Pearson-product moment 
correlation between two sets of observed scores will be lower 
than what it would have been had the measurements been error 
free. Spearman (1904a) called this lowering of a correlation 
coefficient due to the fallibility of measurement attenuation 
and provided the basic procedure for estimating what the value 
of a correlation coefficient would be if the errors of measure- 
ment were eliminated. The basic formula is: 

, n , - . o(X,Y) , (1) 

P(T x ,T y ) = {p(x,X') p(Y»Y , )J >s 

where £(X,Y) is the population correlation between observed scores 
on test X and test Y, £(X,X' ) and £(Y,Y' ) are the population values 
of the reliabilities of test X and test Y, and £(Tx*T y ) the 
correlation between true scores for test X and test Y. Lord (1957) 
called the corrected correlation the disattenuated correlation . 

Sample estimates, r(T ,T ) , of £(T x ,T y ) are obtained by 
substituting in formula (1) sample estimates for £(X,Y) , £(X,X’ ), 
and £ (Y , Y ' ) which incorporate a consistent definition of error, 
i.e., the reliability estimates treat as error those factors 
which attenuate the correlation between X and Y. The testing 
paradigm simulated in the present study involves administering 
both test X and test Y on one test occasion followed by a second 
administration after a suitable time has elapsed: 
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An estimate of £(T^,Ty) consistent with this design is: 



r(X x ,Y 2 ) + r(X 2 ,Y 1 ) 



( 2 ) 



Several other formulas for obtaining estimates of p(T x ,Ty) 

consistent with this design have been presented in the literature 

(Spearman i 1904a, 1907; Yule (see Appendix C in Spearman, 1910); 

Lord, 1957). Formula (2) differs from Yule's formula in that 

the arithmetic mean of the correlations between test X and test 

Y is used instead of their geometric mean. If it can be assumed 

that the series of measurements have been conducted with equal 

accuracy, then the differences in value between £(2ii/X2^ an< ^ 

r(X.,Y ) can be attributed to chance and can, therefore, be 
— “2 “1 

taken care of by taking an average. In contrast to the formulas 
of Spearman and Lord, the same administration correlations between 
test X and test Y (r(X ,Y ) and r(X,,Y 0 $) are ignored since the 
factor of contemporaneity, which can enhance these correlations, 
is not present in the estimates of reliability. 

Both the correlations between repeated measures (test-retest 
reliabilities) and the correlations between distinct measures 
include as error variance fluctuations from one test occasion to 
the next. In contrast, internal analyses and parallel forms 
estimates of reliability generally result in an inconsistent 
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